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Practice description 



Phonological Awareness Training plus Letter Knowledge Training 
is a general practice aimed at enhancing young children’s pho- 
nological awareness, print awareness, and early reading abilities. 
Phonological awareness, the ability to detect or manipulate the 
sounds in words independent of meaning, is a precursor to read- 
ing. Phonological awareness training without letter knowledge 
training can involve various training activities that focus on teach- 
ing children to identify, detect, delete, segment, or blend seg- 
ments of spoken words (i.e., words, syllables, onsets and rimes, 



phonemes) or that focus on teaching children to detect, identify, 
or produce rhyme or alliteration. The added letter knowledge 
training component includes teaching children the letters of the 
alphabet and making an explicit link between letters and sounds. 
Both skills are related to beginning reading. Three related What 
Works Clearinghouse (WWC) intervention reports review two 
curricula for phonological awareness — DaisyQuest and Sound 
Foundations — and a similar practice — Phonological Awareness 
Training without letter knowledge training. 



Research One study of Phonological Awareness Training plus Letter Knowl- 
edge Training met the WWC evidence standards and two studies 
met WWC evidence standards with reservations. 1 Together, 
these three studies included more than 230 preschool children 
from upstate New York, two Midwestern communities, and 
another unidentified state. They examined intervention effects on 



children’s oral language, print knowledge, phonological process- 
ing, early reading/writing, and cognition. Most of the children 
studied were from economically disadvantaged backgrounds, 
and about one-fourth of the children were raised in non-English- 
speaking families. This report focuses on immediate posttest 
findings to determine the effectiveness of the intervention. 2 



Effectiveness Phonological Awareness Training plus Letter Knowledge Training was found to have potentially negative effects on oral language, 
positive effects on print knowledge, potentially positive effects on phonological processing and early reading/writing, and no dis- 
cernible effects on cognition. 

1. To be eligible for the WWC’s review, the Early Childhood Education (ECE) interventions had to be implemented in English in center-based settings with 
children ages 3 to 5 or in preschool. 

2. The evidence presented in this report is based on available research. Findings and conclusions may change as new research becomes available. 
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Effectiveness (continued) 


Oral language 


Print 

knowledge 


Phonological 

processing 


Early reading/ 
writing 


Cognition 


Math 


Rating of effectiveness 


Potentially 


Positive effects 


Potentially 


Potentially 


No discernible 


N/A 




negative effects 3 




positive effects 


positive effects 


effects 




Improvement index 4 


Average: -12 


Average: +27 


Average: +28 


Average: +19 


Average: +4 


N/A 




percentile points 


percentile points 


percentile points 


percentile points 


percentile points 






Range: -34 to +4 


Range: +4 to +40 


Range: +1 to +50 


Range: -2 to +39 


Range: +2 to +7 






percentile points 


percentile points 


percentile points 


percentile points 


percentile points 





Additional practice 
information 



Developer and contact 

Phonological Awareness Training plus Letter Knowledge 
Training is a practice that does not have a single developer 
responsible for providing information or materials. The interven- 
tions described in this report were developed by the study 
authors and are not available for distribution through a common 
developer. Readers interested in using Phonological Awareness 
Training plus Letter Knowledge Training practices in their class- 
room can refer to sources available through internet searches 
for information. A list of examples follows which has not been 
reviewed or endorsed by the WWC: 

• Phonological Awareness: Instructional and Assessment 
Guidelines: http://www.ldonline.org/article/6254 . 

• Ideas and Activities for Developing Phonological Awareness 
Skills: A Teacher Resource Supplement to the Virginia Early 
Intervention Reading Initiative: http://www.pen.k12.va.us/ 
VDOE/lnstruction/Readina/findinas.pdf . 

• Reading Rockets: Teacher Toolbox — Phonological Awareness: 
The Phive Phones of Reading: http://www.readingrockets. 
ora/firstvear/fvt.php?SUB=33 . 



Reading Rockets: Problems Involving Phonological and 
Phonemic Awareness: http ://www. read i ng rockets.org/ 
helping/ target/phonologicalphonemic . 

Phonological Awareness Skills and Spelling Skills: 
http://cla.calpolv.edu/~irubba/phon/phonaware.html . 

Vaughn Gross Center for Reading and Language Arts, 
University of Texas at Austin: http://www.texasreading. 
oro/utcrla/materials/primarv phono awareness.asp . 
Phonological Awareness and Reading Recovery: http://www. 
readinarecoverv.org/sections/readina/phonics.asp . 

Improving Reading Fluency: Phonological Awareness Train- 
ing: http://www.speechpatholoav.com/Articles/article detail. 
asp?article id=68 . 

Florida Center for Reading Research: http://www.fcrr.org . 
University of Oregon: http://www.readina.uoreaon.edu . 
National Reading Panel: http://www.nationalreadingpanel.org 
State Center for Early Childhood Development: 
http://www.uth.tmc.edu/circle/letter know.htm . 

PBS: http://pbskids.org/lions/parentsteachers/program/ 
curriculum/letter.html . 

Philadelphia Public Schools Head Start: 
http://www.lakeshorelearningsolutions.com/phillv3.html . 



3. The rating of a potentially negative effect for the oral language domain is most likely due to the comparison condition in Roberts and Neal (2004), which 
focused on increasing children’s vocabulary and language comprehension. It would be expected to have a greater impact on oral language than would 
letter-rhyme training, which is not intended to impact children’s vocabulary or language comprehension skills. 

4. These numbers show the average and range of improvement indices for all findings across the studies. 
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• Southwest Educational Development Laboratory: 

http://www.sedl.org/readinq/framework/nonflash/letter.html . 

• Kaplan Early Learning Company: http://www.kaplanco.com/ 
store/trans/productDetailForm.asp?CatlD=5%7CLT1045%7C 
0&ColllD=14905&Max=236&ID=3&Paqe=1 . 

Scope of use 

Information is not available on the number or demographics of 
children or centers using these practices. 

Teaching 

Phonological Awareness Training plus Letter Knowledge Training 
practices can be used by teachers with individual children or 
in small or large group settings. These practices generally are 
used as a supplement to the regular classroom curriculum, and 
they have been used with specific subpopulations of students, 
such as children whose primary language is not English or 
children who are at-risk of later reading difficulties. Phonological 
awareness training practices vary in their scope and may include 



activities such as rhyme detection training (e.g., teachers may 
engage children in a game involving rhyming words and ask 
them about which word in a series of three does not sound 
like the others), blending training (e.g., teachers may say three 
sounds and teach children how to blend sounds together to 
make a word), and segmentation training (e.g., teachers may say 
a short word such as “cat” and teach children how to separate 
the word into the three sounds that make up the word) at the 
phoneme, syllable, or word level. Letter knowledge training 
practices may include activities to learn the names of letters, 
recognize the correspondence between letters and sounds, and 
identify letters in print. Both skills are related to beginning read- 
ing and may be taught prior to different instructional approaches 
to teaching reading. 5 

Cost 

Information is not available about the costs of teacher training 
and implementation of Phonological Awareness Training plus 
Letter Knowledge Training practices. 



Three studies reviewed by the WWC investigated the effects of 
Phonological Awareness Training plus Letter Knowledge Training 
practices in center-based settings. One study (Gettinger, 1986) 
was a randomized controlled trial that met WWC evidence 
standards. One study (Roberts & Neal, 2004 6 ) was a randomized 
controlled trial that met WWC evidence standards with reserva- 
tions because of high overall and differential attrition. One study 
(Pietrangelo, 1999) was a quasi-experimental design that met 
WWC evidence standards with reservations. 



Met evidence standards 

Gettinger (1986) included 72 four- and five-year-old children from 
preschools located in two Midwestern communities. Sixty-six 
percent of the children were white, 22% were black, and 12% 
were Hispanic. Forty-four percent of the children were female, 
and a range of socioeconomic status levels was represented. 
Gettinger compared print knowledge and phonological 
processing outcomes for children participating in an early 
literacy reading skills training program that included instruction 
in phonological awareness and letter knowledge training with 
outcomes for children participating in training in other skills 



5. Readers who are unfamiliar with the terminology related to Phonological Awareness Training and the development of reading may find it helpful to consult 
the glossary of terms available from the National Institute for Literacy ( http://www.nifl.aov/partnershipforreadina/alossarv/alossarv.htmh and the definitions 
of outcome measures in Appendices A2.1-A2.5. 

6. Roberts (2003) reported on a subsample from Roberts and Neal (2004) and was reviewed along with that study. 



Phonological Awareness Training plus Letter Knowledge Training 



December 28, 2006 



3 




Research (continued) 



Effectiveness 



unrelated to phonological awareness and letter knowledge. 
Gettinger also reported the effects of the skills training program 
on early reading/writing outcomes for the same children, all 
of whom (intervention and comparison group children) were 
participating in different approaches to teaching reading (i.e., 
sight word, linguistics, or phonetics) after the initial skills training 
program for intervention group children had ended. 

Met evidence standards with reservations 

Roberts and Neal (2004) included 33 three- and four-year-old 
children from low-income families whose primary language 
was either Hmong or Spanish. All children were attending a 
half-day, state-funded preschool. Roberts and Neal compared 
oral language, print knowledge, phonological processing, and 
early reading/writing outcomes for children participating in a 
phonological awareness and letter knowledge intervention group 



(i.e., letter-rhyme group) with outcomes for children participating 
in a language comprehension intervention. 

Pietrangelo (1999) included 124 four-year-old low-income 
children who attended 10 Head Start classrooms in upstate New 
York. Eighty-three percent of the treatment and comparison 
children came from English-speaking families, while 17% 
resided with non-English-speaking families. Twenty-nine percent 
of the children were black, 22% were Hispanic or Latino, 42% 
were white, and 7% were Asian. Forty-eight percent of the 
children were female. Pietrangelo compared oral language, print 
knowledge, phonological processing, early reading/writing, and 
cognition outcomes for children participating in a supplemental 
early literacy skills program that focused on teaching phonologi- 
cal awareness skills and letter knowledge with outcomes for 
children participating only in their regular Head Start curriculum. 



Findings 

The WWC review of interventions for early childhood education 
addresses children’s outcomes in six domains: oral language, 
print knowledge, phonological processing, early reading/writing, 
cognition, and math. 7 

Oral language. Two studies examined outcomes in the domain 
of oral language. One study showed statistically significant and 
negative effects, and one study showed indeterminate effects. 

Roberts and Neal (2004) reported findings for two outcome 
measures in the oral language domain. One of the findings 
was statistically significant favoring children in the comparison 
group on a measure of vocabulary, 8 and the WWC confirmed the 
statistical significance of this effect. The study author did not 



find a statistically significant difference on a measure of story 
event sequencing. According to WWC criteria, the effect on 
story event sequencing was statistically significant and negative 
when contrasted with the comparison group, which received a 
language comprehension intervention. The finding of a statisti- 
cally significant and negative effect for Phonological Awareness 
Training plus Letter Knowledge Training in this study was most 
likely due to the nature of the comparison condition used, rather 
than an effect of the Phonological Awareness Training plus 
Letter Knowledge Training intervention. The language compre- 
hension intervention used as the comparison condition in this 
study focused on increasing children’s vocabulary and language 
comprehension. Consequently, the comparison condition would 



7. The level of statistical significance was reported by the study authors or, where necessary, calculated by the WWC to correct for clustering within 
classrooms or schools and for multiple comparisons. For an explanation about the clustering correction, see the WWC Tutorial on Mismatch . See Technical 
Details of WWC-Conducted Computations for the formulas the WWC used to calculate the statistical significance. In the case of Phonological Awareness 
Training plus Letter Knowledge Training, corrections for clustering and multiple comparisons were needed. 

8. Roberts and Neal (2004) also assessed children’s English oral language proficiency with a standardized test called the Pre-Idea Proficiency Test. The 
WWC does not include the Pre-Idea Proficiency Test in the report because it was not intended to measure the effects of the intervention. 
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be expected to have a greater impact on children’s oral language 
skills than would letter-rhyme training, which was not intended 
to increase children’s vocabulary and language comprehension 
skills. Pietrangelo (1999) found no statistically significant differ- 
ence between the intervention group and the comparison group 
on a measure of receptive vocabulary. In this study, the effect 
was indeterminate, according to WWC criteria. 

Print knowledge. Three studies examined outcomes in the 
domain of print knowledge. Two studies showed statistically 
significant and positive effects, and one study showed indeter- 
minate effects. 

Gettinger (1986) found a statistically significant difference 
favoring the intervention group on a measure assessing 
children’s knowledge of the names of consonants, and the WWC 
confirmed the statistical significance of this effect. In this study, 
the effect was statistically significant and positive, according 
to WWC criteria. Roberts and Neal (2004) reported a statisti- 
cally significant difference favoring the intervention group on a 
measure assessing children’s knowledge of letter names, 9 and 
the WWC confirmed the statistical significance of this effect. In 
this study, the effect was statistically significant and positive, 
according to WWC criteria. Pietrangelo (1999) examined four 
print knowledge outcome measures and found no statistically 
significant differences between the intervention group and the 
comparison group. In this study, the effect was indeterminate, 
according to WWC criteria. 

Phonological processing. Three studies examined outcomes 
in the domain of phonological processing. One study showed 
statistically significant and positive effects, one study showed 
substantively important and positive effects, and one study 
showed indeterminate effects. 

Gettinger (1986) reported statistically significant differences 
favoring the intervention group on three phonological processing 
outcomes, and the statistical significance of these effects was 



confirmed by the WWC. In this study, the effect was statistically 
significant and positive, according to WWC criteria. Roberts 
and Neal (2004) found no statistically significant difference 
between the intervention group and the comparison group on 
a phonological processing outcome (rhyme production), and 
the effect was not large enough to be considered substantively 
important by WWC criteria. In this study, the effect was indeter- 
minate, according to WWC criteria. Pietrangelo (1999) examined 
the effect of the intervention on three phonological processing 
outcomes and found statistically significant differences favoring 
the intervention group on each measure. The WWC was unable 
to confirm the statistical significance of these effects; however, 
the findings were large enough to categorize the effect as sub- 
stantively important and positive, according to WWC criteria. 

Early reading/writing. Three studies examined outcomes in 
the domain of early reading/writing. One study showed statisti- 
cally significant and positive effects, one study showed sub- 
stantively important and positive effects, and one study showed 
indeterminate effects. 

Gettinger (1986) reported statistically significant differences 
favoring the intervention group for four of five measures, and 
the WWC confirmed the statistical significance of these effects. 

In this study, the effect was statistically significant and positive, 
according to WWC criteria. Roberts and Neal (2004) found no 
statistically significant differences between the intervention 
group and the comparison group for a measure of writing; 
however, the finding was large enough to categorize the effect as 
substantively important and positive, according to WWC criteria. 
Pietrangelo (1999) did not find statistically significant differences 
between the intervention group and the comparison group on 
two early reading/writing outcome measures. In this study, the 
effect was indeterminate, according to WWC criteria. 

Cognition. Pietrangelo (1999) assessed cognition with two out- 
come measures but did not find statistically significant differences 



9. Roberts and Neal (2004) also included a measure of concepts of print. The WWC does not include the measure in this review because it assessed ele- 
ments of both print knowledge and oral language and it cannot be appropriately placed in either domain. 
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The WWC found 
Phonological Awareness 
Training plus Letter 
Knowledge Training to have 
potentially negative effects 
for oral language , 3 positive 
effects for print knowledge, 
potentially positive effects 
for phonological processing 
and early reading/writing, 
and no discernible 
effects for cognition 
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between the intervention group and the comparison group. In this 
study, the effect was indeterminate, according to WWC criteria. 

Rating of effectiveness 

The WWC rates the effects of an intervention in a given outcome 
domain as positive, potentially positive, mixed, no discernible 



effects, potentially negative, or negative. The rating of effective- 
ness takes into account four factors: the quality of the research 
design, the statistical significance of the findings, 7 the size of 
the difference between participants in the intervention condition 
and the comparison condition, and the consistency in findings 
across studies (see the WWC Intervention Rating Scheme) . 



Improvement index 

The WWC computes an improvement index for each individual 
finding. In addition, within each outcome domain, the WWC 
computes an average improvement index for each study and 
an average improvement index across studies (see echnical 
Details of WWC-Conducted Computations) . The improvement 
index represents the difference between the percentile rank 
of the average student in the intervention condition versus 
the percentile rank of the average student in the comparison 
condition. Unlike the rating of effectiveness, the improvement 
index is entirely based on the size of the effect, regardless of 
the statistical significance of the effect, the study design, or the 
analysis. The improvement index can take on values between 
-50 and +50, with positive numbers denoting favorable results. 
The average improvement index for oral language is -12 
percentile points across the two studies, with a range of -34 
to +4 percentile points across findings. The average improve- 
ment index for print knowledge is +27 percentile points across 
the three studies, with a range of +4 to +40 percentile points 
across findings. The average improvement index for phono- 
logical processing is +28 percentile points across the three 



studies, with a range of +1 to +50 percentile points across find- 
ings. The average improvement index for early reading/writing 
is +19 percentile points across the three studies, with a range 
of -2 to +39 percentile points across findings. The average 
improvement index for cognition is +4 percentile points for one 
study, with a range of +2 to +7 percentile points across findings 
within the study. 

Summary 

The WWC reviewed three studies on Phonological Awareness 
Training plus Letter Knowledge Training. One of these studies 
met WWC evidence standards, and two studies met WWC 
evidence standards with reservations. Based on these three 
studies, the WWC found positive effects for print knowledge, 
potentially positive effects for phonological processing and early 
reading/writing, and no discernible effects for cognition. The 
WWC also found a potentially negative effect for oral language; 
however, this finding is likely the result of the comparison group 
used in one of the studies and not a general result of the inter- 
vention. The evidence presented in this report may change as 
new research emerges. 
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Appendix A1.1 


Study characteristics: Gettinger, 1986 (randomized controlled trial) 


Characteristic 


Description 


Study citation 


Gettinger, M. (1986). Prereading skills and achievement under three approaches to teaching word recognition. Journal of Research and Development in Education, 19(2), 1-9. 


Participants 


The study began with 122 four- and five-year-old children who were pretested on four measures. Based on pretest scores, 26 children were eliminated because they scored 
with greater than 75% accuracy on at least one of the pretest measures. The remaining children were blocked on pretest scores, gender, and age and randomly assigned to 
either the intervention or comparison conditions. The matching procedure resulted in a loss of 24 children, resulting in a final sample of 72 children. Sixty-six percent of the 
children were white, 22% were black, and 12% were Hispanic or other backgrounds. Forty-four percent of the children were female, and a range of socioeconomic status 
levels were represented (11% upper middle, 38% middle, 31% lower middle, and 20% lower). 


Setting 


The study took place in preschools in two Midwestern communities. 


Intervention 


The children in the intervention group participated in phonological awareness and letter knowledge (PAT + LK) skills training. PAT + /./(skills training was delivered to children 
in instructional subgroups, to which they had been randomly assigned, during three 30-minute lessons a week over three consecutive weeks. During each skills training 
session children were taught to recognize, name, produce the sound for, and blend (initial and final positions) two consonants each day, so that by the end of the intervention 
all children had been taught 18 consonants. Each lesson followed a similar structure and ended with a cumulative review of all syllables learned. Next, children participated in 
nine additional 30-minute reading instruction lessons over three consecutive weeks (i.e., three lessons a week for three weeks) to learn how to read using either a sight word 
approach, a linguistic approach, or a phonetic approach. The reading instruction lessons were designed to assess the effect of PAT + /./(skills training on early reading/writing 
outcomes. The WWC does not report the results of the separate reading instruction conditions in this report because they are not Phonological Awareness Training plus Letter 
Knowledge Training interventions. However, the WWC does report the results for the early reading/writing outcomes combined across reading instruction conditions because 
effects on those measures can be attributed to the initial skills training. 


Comparison 


The children in the comparison group participated in training in skills other than those related to phonological awareness and letter knowledge. The other skills training was 
delivered to children in instructional subgroups, to which they had been randomly assigned, during three 30-minute lessons a week over three consecutive weeks. During 
the other skills training, children participated in activities such as practice in color and number naming and picture identification. Next, children participated in nine additional 
30-minute reading instruction lessons over three consecutive weeks (i.e., three lessons a week for three weeks) to learn how to read using either a sight word approach, a 
linguistic approach, or a phonetic approach. The WWC does not report the results of the separate reading instruction conditions in this report because they are not Phonologi- 
cal Awareness Training plus Letter Knowledge Training interventions. However, the WWC does report the results for the early reading/writing outcomes combined across 
reading instruction conditions because effects on those measures can be attributed to the initial skills training. 


Primary outcomes 
and measurement 


The primary outcome domains assessed were print knowledge and phonological processing (measured immediately after the skills training), and early reading/writing (mea- 
sured after completion of the skills training but during reading instruction training). Print knowledge was assessed with one nonstandardized measure — consonant names. 
Phonological processing was assessed with three nonstandardized measures — consonant sounds, sound memory, and sound blending. Early reading/writing was assessed 
by five nonstandardized measures — training words, transfer words, short vowel in transfer words, trials-to-criterion, and discrimination. (See Appendices A2.2-A2.4 for more 
detailed descriptions of outcome measures.) 


Teacher training 


The intervention and comparison conditions were implemented by 11 preschool teachers or aides who had at least two years experience with preschool-age children and who 
received two hours of training involving the reading of prepared scripts and simulated activities for the lessons. All teachers were familiar with the children in the groups they taught. 
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Appendix A1.2 Study characteristics: Roberts & Neal, 2004 (randomized controlled trial with attrition problems) 



Characteristic 


Description 


Study citation 


Roberts, T., & Neal, H. (2004). Relationships among preschool English language learners' oral proficiency in English, instructional experience and literacy development. 
Contemporary Educational Psychology, 29(3), 283-311. 

Additional source: 

Roberts, T. A. (2003). Effects of alphabet-letter instruction on young children’s word recognition. Journal of Educational Psychology, 95(1), 41-51. 


Participants 1 


The study began with 43 three- to four-year-old low-income children. During the course of the study, four children moved, one child was excluded because of a high level of 
missing data, and five children were excluded because English was their primary language. The final sample included 33 Hmong- or Spanish-speaking children. The children 
ranged in age from 42 to 58 months (mean age = 52.8 months), and 64% were female. The children were blocked by primary language and randomly assigned across morn- 
ing and afternoon classrooms to either the intervention or comparison conditions. 


Setting 


The study took place in a half-day, state-funded preschool program. 


Intervention 


The WWC designated the letter-rhyme group as the intervention condition for this review. The children in this group participated in a total of 48 lessons lasting 20-25 minutes 
each (three lessons a week for 16 weeks) in small groups that focused on improving children’s phonological awareness skills and letter knowledge. Each week, the children 
were introduced to a new letter in the alphabet, learned to name and write the letter, and used the letter to participate in rhyming activities (e.g., distinguishing rhyming words 
from nonrhyming words, recognizing rhyme, generating rhyme). 


Comparison 


The WWC designated the language comprehension group as the comparison condition for this review. The children in the language comprehension condition participated in a 
total of 48 lessons lasting 20-25 minutes each (three lessons a week for 16 weeks) in small groups. Each week, the children watched a video of a book followed by pretend 
reading of the book with teacher support (e.g., the teacher responded to children's story-related language and pointing). During subsequent weekly sessions, the children 
engaged in activities to learn key vocabulary from the text, fingerpoint reading of the text to promote print awareness, and activities such as acting out the events from the 
story and putting in order pictures representing events in the story. 


Primary outcomes 
and measurement 2 


The primary outcome domains assessed were oral language, print knowledge, phonological processing, and early reading/writing. Oral language was measured by two non- 
standardized tests — vocabulary and story event sequencing — and a standardized test of English oral language proficiency — the Pre-Idea Proficiency Test. The WWC does not 
include the Pre-Idea Proficiency Test in this review because it was not intended to assess the effects of the intervention. Print knowledge was assessed by one nonstandardized 
measure — letter names. Phonological processing was measured by a nonstandardized test of rhyming. Early reading/writing was assessed by one nonstandardized measure 
of writing. The study also used a nonstandardized test of print concepts; however, it measured elements of both oral language and print knowledge and cannot be appropriately 
placed in either domain. So, the WWC does not include this measure in the review. (See Appendices A2.1-A2.4 for more detailed descriptions of outcome measures.) 


Teacher training 


The intervention and comparison conditions were conducted by two undergraduate students who alternated between the letter/rhyme and comprehension conditions every 
two weeks for 16 weeks. They received about four hours of training and ongoing feedback from the researcher. Initial training included reviewing and discussing the lesson 
scripts and goals, observing two lessons, and practicing two lessons. 



1. The overlap in samples between the two studies was substantial enough to treat this as one study. The children in Roberts (2003) were a subsample from the Roberts and Neal (2004) study. 
Specifically, Roberts (2003) included 29 children from Roberts and Neal (2004) and four of the five native English speakers from the original sample. 

2. The immediate posttests for Roberts (2003) are the same as those used in Roberts and Neal (2004) and are not included in this review. The WWC does not include the measures used following 
the word-learning training because the purpose of these measures is to test the parameters of learnability (i.e., teaching letters helps children learn the phonetics involved in reading). 
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Appendix A1.3 Study characteristics: Pietrangelo, 1999 (quasi-experimental design) 



Characteristic 


Description 


Study citation 


Pietrangelo, D. J. (1999). Outcomes of an enhanced literacy curriculum on the emergent literacy skills of Head Start preschoolers. Dissertation Abstracts International, 60(4), 
1014A. (UMI No. 9927614). 


Participants 


The study began with 139 four-year-old low-income children. During the course of the study, 10 children left the study, resulting in a final sample of 129 children from 10 
classes. Eighty-three percent of the treatment and comparison children came from English-speaking families, and 17% of the children resided with non-English-speaking 
families. Twenty-nine percent of the children were black, 22% were Hispanic or Latino, 42% were white, and 7% were Asian (primarily Afghan). Forty-eight percent of the 
children were female. Classrooms were first matched on half-day or full-day status, and nine of the classrooms were randomly assigned to either the intervention or compari- 
son conditions. The 10th classroom was placed in the comparison group because the intervention materials were not accessible to the teacher. Because the 10th classroom 
was assigned by convenience, the design for this study is quasi-experimental. 


Setting 


The study took place in a Head Start program in upstate New York. 


Intervention 


The children in the intervention group participated in 14 weeks of early literacy instruction designed to supplement the existing Head Start curriculum. 1 The early literacy 
instruction focused on teaching phonological awareness skills and letter knowledge, such as letter names, letter sounds, and phonemic composition of words. Twenty pre- 
school books were introduced in large and small groups (about six children per small group), and children were encouraged to participate in discussions and to read. Children 
were also exposed to explicit instruction in letter names and letter sounds, and each lesson plan included phoneme awareness training using game-like activities. 


Comparison 


The children in the comparison group participated in their regular Head Start curriculum that consisted of few emergent literacy activities and varied book reading activities. 


Primary outcomes 
and measurement 


The primary outcome domains assessed were oral language, print knowledge, phonological processing, early reading/writing, and cognition. Oral language was measured with 
the Peabody Picture Vocabulary Test (PPVT-III), a standardized measure. Print knowledge was assessed with four nonstandardized measures — alphabet knowledge, letter 
identification, letter-sound correspondence, and print conventions. Phonological processing was assessed with three nonstandardized measures — alliteration, rhyming, and 
phoneme blending. Early reading/writing was assessed with two nonstandardized measures — invented spelling and word identification. The cognition domain was assessed 
with two nonstandardized measures — sentence memory and word memory. (See Appendices A2.1-A2.5 for more detailed descriptions of outcome measures.) 


Teacher training 


Teachers received an orientation packet, participated in one session of training prior to the intervention, and received weekly training once the intervention began. During the 
weekly training, teachers reviewed lesson plans, and trainers addressed teacher concerns and suggestions and answered teacher questions. Because teachers implemented 
the intervention in their respective program and groups, they were familiar with the children in the intervention and comparison conditions. 



1. Pietrangelo (1999) reported contradictory intervention lengths (14 weeks and 12 weeks). Some of the supplementary materials were drawn from the Ready Readers program. 
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Appendix A2.1 Outcome measures in the oral language domain 



Outcome measure 


Description 


Vocabulary 


A researcher-developed measure designed to assess children’s vocabulary by showing children a series of cards, each with four pictures, and asking them to point to the 
picture representing the target vocabulary word (as cited in Roberts and Neal, 2004). 


Story event sequencing 


A researcher-developed measure that requires children to place pictures from a story in the proper sequential order (as cited in Roberts and Neal, 2004). 


Peabody Picture Vocabulary 
Test, 3rd Edition (PPVT-III) 


A standardized measure of children’s receptive vocabulary that requires them to point to one of four pictures that represents a word that the examiner says (as cited in 
Pietrangelo, 1999). 



Appendix A2.2 Outcome measures in the print knowledge domain 



Outcome measure 


Description 


Consonant names 


A researcher-developed measure that assesses children's knowledge of consonants by requiring them to name each of 18 consonants presented by the researcher (as cited in 
Gettinger, 1986). 


Letter names 


A researcher-developed measure designed to assess children’s knowledge of letters by presenting children with 16 cards in random order, each with a letter of the alphabet (A 
through P) printed on it, and asking them to name the letter (as cited in Roberts and Neal, 2004). 


Alphabet knowledge 


A researcher-developed measure designed to assess children’s knowledge of the alphabet by asking children to sing or recite the alphabet (as cited in Pietrangelo, 1999). 


Letter identification 


A researcher-developed measure designed to assess children’s ability to identify letters by presenting each of the 26 letters of the alphabet in a random order, with the excep- 
tion of the first letter of the child’s name, which was presented first to promote success and understanding of the task (as cited in Pietrangelo, 1999). 


Letter-sound 

correspondence 


A researcher-developed measure administered at the same time as the letter identification measure in which children were asked to make the sound corresponding with each 
letter (as cited in Pietrangelo, 1999). 


Print conventions 


A researcher-developed measure based on Clay's Print Concepts Test designed to test children’s knowledge of print conventions by asking them about concepts such as the 
book cover, from where to start reading, and pointing at words (as cited in Pietrangelo, 1999). 



Appendix A2.3 Outcome measures in the phonological processing domain 



Outcome measure 


Description 


Consonant sounds 


A researcher-developed measure that tested the children's ability to produce the sound of 18 consonants presented (as cited in Gettinger, 1986). 


Sound memory 


A researcher-developed measure that tested the children's ability to produce two sounds (e.g., vowel + consonant) in the same sequence as they had been presented by the 
examiner (as cited in Gettinger, 1986). 


Sound blending 


A researcher-developed measure that tested the children's ability to blend together two sounds (e.g., vowel + consonant) that were presented by the examiner to produce the 
syllable correctly (as cited in Gettinger, 1986). 

(continued) 
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Appendix A2.3 Outcome measures in the phonological processing domain (continued) 



Outcome measure 


Description 


Rhyme 


A researcher-developed measure that requires children to listen to 10 monosyllabic words and to produce the rhyming word (as cited in Roberts and Neal, 2004). 1 


Alliteration 


A researcher-developed measure that requires children to identify two of three words that start with the same sound (as cited in Pietrangelo, 1999). 


Rhyming 


A researcher-developed measure that requires children to identify two words that rhyme from a series of three words presented in pictures (as cited in Pietrangelo, 1999). 


Phoneme blending 


A researcher-developed measure during which the child listens to segments of words and is asked to blend them together (as cited in Pietrangelo, 1999). 



1. Roberts and Neal (2004) stated that there was a floor effect for this measure. 

Appendix A2.4 Outcome measures in the early reading/writing domain 



Outcome measure 


Description 


Training words 


A researcher-developed measure that requires children to read one of 10 words that they were trained on during the weekly lessons (as cited in Gettinger, 1986). 


Transfer words 


A researcher-developed measure that requires children to read one of 10 transfer words where six had the same initial bigrams as the training words and four had the same 
media vowel used in the training words (as cited in Gettinger, 1986). 


Short vowel in transfer words 


A researcher-developed measure that assesses the number of times the child produced the short vowel sound accurately in the transfer words, regardless of whether the child 
said the entire word correctly (as cited in Gettinger, 1986). 


Trials-to-criterion 


A researcher-developed measure that assesses children's learning rate by determining how many trials were needed to learn a word (as cited in Gettinger, 1986). For the purposes 
of this review and to make effect size estimates consistent across measures, the WWC reversed the direction of the effect so that a higher score reflected a better outcome. 


Discrimination 


A researcher-developed measure that tested children’s ability to accurately identify training words from nonsense miscues (as cited in Gettinger, 1986). 


Writing 


A researcher-developed measure that requires children to write their names, seven letters of the alphabet, three words that are dictated to them, and any additional words that 
they wish to write (as cited in Roberts and Neal, 2004). 


Letter writing portion 
of the writing task 


A portion of the writing measure described above during which children are asked to write seven letters of the alphabet (as cited in Roberts and Neal, 2004). 


Invented spelling 


A researcher-developed measure that requires children to write five words that are said to them individually and in the context of a sentence (as cited in Pietrangelo, 1999). 


Word identification 


A researcher-developed measure that requires children to pronounce each of 20 isolated words that were presented in print (as cited in Pietrangelo, 1999). 
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Appendix A2.5 Outcome measures in the cognition domain 



Outcome measure 


Description 


Sentence memory 


A researcher-developed measure that assesses children's memory by asking children to recall verbatim sentences ranging from three to 12 words each (as cited in 
Pietrangelo, 1999). 


Word memory 


A researcher-developed measure that assess children’s memory by presenting children with the same words from the sentence memory test (described above) and asking 
children to recall in the original order presented the words in each string (as cited in Pietrangelo, 1999). 



WWC Intervention Report Phonological Awareness Training plus Letter Knowledge Training 



December 28, 2006 



13 





Appendix A3.1 



Summary of study findings included in the rating for the oral language domain 1 









Author’s findings from the study 














Mean outcome 
(standard deviation 2 ) 




WWC calculations 
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Mean difference 3 
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PAT + LK Comparison 


(PAT + LK- 


significance 5 


Improvement 


Outcome measure 


sample 


children) 
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comparison) 


Effect size 4 (at a = 0.05) 


index 6 



Vocabulary 3-4 year olds 


Roberts & Neal, 2004 (randomized controlled trial with attrition problems) 7 

33 18.93 24.21 -5.28 -1.00 

(5.32) (5.06) 


Statistically 

significant 


-34 


Story event sequencing 3-4 year olds 
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4.07 
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(3.84) 


-1.82 


-0.46 
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Average 8 for oral language (Roberts & Neal, 2004) 










-0.73 
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Pietrangelo, 1999 (quasi-experimental design) 9 
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Average 8 for oral language (Pietrangelo, 1999) 
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ns 


+4 


Domain average 8 for oral language across all studies 








-0.32 


na 


-12 



PAT + LK= Phonological Awareness Training plus Letter Knowledge Training 

ns = not statistically significant 

na = not applicable 

1. This appendix reports findings considered for the effectiveness rating and the average improvement indices. Subgroup findings from the same studies are not included in these ratings, but are reported in Appendix A4.1. 

2. The standard deviation across all students in each group shows how dispersed the participants’ outcomes are: a smaller standard deviation on a given measure would indicate that participants had more similar outcomes. 

3. Positive differences and effect sizes favor the intervention group; negative differences and effect sizes favor the comparison group. 

4. For an explanation of the effect size calculation, see Technical Details of WWC-Conducted Computations . 

5. Statistical significance is the probability that the difference between groups is a result of chance rather than a real difference between the groups. 

6. The improvement index represents the difference between the percentile rank of the average student in the intervention condition and that of the average student in the comparison condition. The improvement index can take on values 
between -50 and +50, with positive numbers denoting favorable results. 

7. The level of statistical significance was reported by the study authors or, where necessary, calculated by the WWC to correct for clustering within classrooms or schools and for multiple comparisons. For an explanation about the clus- 
tering correction, see the WWC Tutorial on Mismatch . See Technical Details of WWC-Conducted Computations for the formulas the WWC used to calculate statistical significance. In the case of Roberts and Neal (2004), a correction for 
multiple comparisons was needed, but the significance levels do not differ from those reported in the original study. 

8. The WWC-computed average effect sizes for each study and for the domain across studies are simple averages rounded to two decimal places. The average improvement indices are calculated from the average effect sizes. 

9. In the case of Pietrangelo (1999), a correction for clustering was needed, but the significance level does not differ from that reported in the original study. 
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Appendix A3.2 Summary of study findings included in the rating for the print knowledge domain 1 









Author’s findings from the study 
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Average 9 for print knowledge (Gettinger, 1986) 
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Roberts & Neal, 2004 (randomized controlled trial with attrition problems) 10 
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Pietrangelo, 1999 (quasi-experimental design) 11 
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Letter identification 
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(2.87) 
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Print conventions 


4 year olds 
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Domain average 9 for print knowledge across ail studies 
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na 
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PAT + LK= Phonological Awareness Training plus Letter Knowledge Training 
ns = not statistically significant 
na = not applicable 

1. This appendix reports findings considered for the effectiveness rating and the average improvement indices. Subgroup findings from the same studies are not included in these ratings, but are reported in Appendix A4.2. 

2. The standard deviation across all students in each group shows how dispersed the participants’ outcomes are: a smaller standard deviation on a given measure would indicate that participants had more similar outcomes. 

3. For Pietrangelo (1999), the intervention group mean equals the comparison group mean plus the mean difference. 

(continued) 
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Appendix A3.2 Summary of study findings included in the rating for the print knowledge domain (continued) 



4. Positive differences and effect sizes favor the intervention group; negative differences and effect sizes favor the comparison group. For Pietrangelo (1999), the mean differences were computed by the WWC and took into account the 
pretest difference between the study groups. The resulting effect sizes may overestimate the intervention's effect when the intervention group had lower pretest scores than the comparison group and underestimate the intervention's 
effect when the intervention group had higher pretest scores than the comparison group. 

5. For an explanation of the effect size calculation, see Technical Details of WWC-Conducted Computations . 

6. Statistical significance is the probability that the difference between groups is a result of chance rather than a real difference between the groups. 

7. The improvement index represents the difference between the percentile rank of the average student in the intervention condition and that of the average student in the comparison condition. The improvement index can take on values 
between -50 and +50, with positive numbers denoting favorable results. 

8. The level of statistical significance was reported by the study authors or, where necessary, calculated by the WWC to correct for clustering within classrooms or schools and for multiple comparisons. For an explanation about the 
clustering correction, see the WWC Tutorial on Mismatch . See Technical Details of WWC-Conducted Computations for the formulas the WWC used to calculate statistical significance. In the case of Gettinger (1986), no corrections for 
clustering or multiple comparisons were needed. 

9. The WWC-computed average effect sizes for each study and for the domain across studies are simple averages rounded to two decimal places. The average improvement indices are calculated from the average effect sizes. 

10. In the case of Roberts and Neal (2004), no corrections for clustering or multiple comparisons were needed. 

11. In the case of Pietrangelo (1999), a correction for clustering was needed, but the significance levels do not differ from those reported in the original study. 
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Appendix A3.3 Summary of study findings included in the rating for the phonological processing domain 1 









Author’s findings from the study 
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Sound memory 


4-5 year olds 


72 


28.93 

(7.20) 


23.66 

(7.83) 


5.27 
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+26 
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(3.98) 
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Statistically 

significant 


+50 


Average 9 for phonological processing (Gettinger, 1986) 
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Statistically 

significant 
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Pietrangelo, 1999 (quasi-experimental design) 11 
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PAT +LK= Phonological Awareness Training plus Letter Knowledge Training 
ns = not statistically significant 
na = not applicable 

1. This appendix reports findings considered for the effectiveness rating and the average improvement indices. 

2. The standard deviation across all students in each group shows how dispersed the participants’ outcomes are: a smaller standard deviation on a given measure would indicate that participants had more similar outcomes. 

3. For Pietrangelo (1999), the intervention group mean equals the comparison group mean plus the mean difference. 

(continued) 
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Appendix A3.3 Summary of study findings included in the rating for the phonological processing domain (continued) 



4. Positive differences and effect sizes favor the intervention group; negative differences and effect sizes favor the comparison group. For Pietrangelo (1999), the mean differences were computed by the WWC and took into account the 
pretest difference between the study groups. The resulting effect sizes may overestimate the intervention's effect when the intervention group had lower pretest scores than the comparison group and underestimate the intervention's 
effect when the intervention group had higher pretest scores than the comparison group. 

5. For an explanation of the effect size calculation, see Technical Details of WWC-Conducted Computations . 

6. Statistical significance is the probability that the difference between groups is a result of chance rather than a real difference between the groups. 

7. The improvement index represents the difference between the percentile rank of the average student in the intervention condition and that of the average student in the comparison condition. The improvement index can take on values 
between -50 and +50, with positive numbers denoting favorable results. 

8. The level of statistical significance was reported by the study authors or, where necessary, calculated by the WWC to correct for clustering within classrooms or schools and for multiple comparisons. For an explanation about the 

clustering correction, see the WWC Tutorial on Mismatch . See Technical Details of WWC-Conducted Computations for the formulas the WWC used to calculate statistical significance. In the case of Gettinger (1986), a correction for 

multiple comparisons was needed, but the significance levels do not differ from those reported in the original study. 

9. The WWC-computed average effect sizes for each study and for the domain across studies are simple averages rounded to two decimal places. The average improvement indices are calculated from the average effect sizes. 

10. In the case of Roberts and Neal (2004), no corrections for clustering or multiple comparisons were needed. 

11. In the case of Pietrangelo (1999), a correction for clustering was needed, so the significance levels may differ from those reported in the original study. 
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Appendix A3.4 Summary of study findings included in the rating for the early reading/writing domain 1 









Author’s findings from the study 
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Pietrangelo, 1999 (quasi-experimental design) 12 
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PAT +LK= Phonological Awareness Training plus Letter Knowledge Training 
ns = not statistically significant 
na = not applicable 

(continued) 
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Appendix A3.4 Summary of study findings included in the rating for the early reading/writing domain (continued) 



1 . This appendix reports findings considered for the effectiveness rating and the average improvement indices. Subgroup and subscale findings from the same studies are not included in these ratings, but are reported in Appendices A4.3 
and A4.4. 

2. The standard deviation across all students in each group shows how dispersed the participants' outcomes are: a smaller standard deviation on a given measure would indicate that participants had more similar outcomes. 

3. For Pietrangelo (1999), the intervention group mean equals the comparison group mean plus the mean difference. 

4. Positive differences and effect sizes favor the intervention group; negative differences and effect sizes favor the comparison group. For Pietrangelo (1999), the mean differences were computed by the WWC and took into account the 
pretest difference between the study groups. The resulting effect sizes may overestimate the intervention's effect when the intervention group had lower pretest scores than the comparison group and underestimate the intervention's 
effect when the intervention group had higher pretest scores than the comparison group. For Gettinger (1986), the scores represent the posttest means across the three teaching approaches (sight, linguistic, and phonetic) that chil- 
dren were exposed to during phase two training to assess the effects of PAT + /./C skills training during completion of reading instruction. To provide consistency in direction of effect size estimates across measures, the WWC reversed 
the direction of the effect for the trials-to-criterion measure so that a higher score reflected a better outcome. 

5. For an explanation of the effect size calculation, see Technical Details of WWC-Conducted Computations . 

6. Statistical significance is the probability that the difference between groups is a result of chance rather than a real difference between the groups. 

7. The improvement index represents the difference between the percentile rank of the average student in the intervention condition and that of the average student in the comparison condition. The improvement index can take on values 
between -50 and +50, with positive numbers denoting favorable results. 

8. The level of statistical significance was reported by the study authors or, where necessary, calculated by the WWC to correct for clustering within classrooms or schools and for multiple comparisons. For an explanation about the 
clustering correction, see the WWC Tutorial on Mismatch . See Technical Details of WWC-Conducted Computations for the formulas the WWC used to calculate statistical significance. In the case of Gettinger (1986), a correction for 
multiple comparisons was needed, so the significance levels may differ from those reported in the original study. 

9. Although the WWC calculations for this measure were statistically significant, the author reported nonstatistically significant findings for this measure. 

10. The WWC-computed average effect sizes for each study and for the domain across studies are simple averages rounded to two decimal places. The average improvement indices are calculated from the average effect sizes. 

11. In the case of Roberts and Neal (2004), no corrections for clustering or multiple comparisons were needed. 

12. In the case of Pietrangelo (1999), a correction for clustering was needed, but the significance levels do not differ from those reported in the original study. 
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Appendix A3.5 Summary of study findings included in the rating for the cognition domain 1 









Author’s findings from the study 
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ns 


+4 



PAT +LK= Phonological Awareness Training plus Letter Knowledge Training 

ns = not statistically significant 

1. This appendix reports findings considered for the effectiveness rating and the average improvement indices. 

2. The standard deviation across all students in each group shows how dispersed the participants’ outcomes are: a smaller standard deviation on a given measure would indicate that participants had more similar outcomes. 

3. Positive differences and effect sizes favor the intervention group; negative differences and effect sizes favor the comparison group. 

4. For an explanation of the effect size calculation, see Technical Details of WWC-Conducted Computations . 

5. Statistical significance is the probability that the difference between groups is a result of chance rather than a real difference between the groups. 

6. The improvement index represents the difference between the percentile rank of the average student in the intervention condition and that of the average student in the comparison condition. The improvement index can take on values 
between -50 and +50, with positive numbers denoting favorable results. 

7. The level of statistical significance was reported by the study authors or, where necessary, calculated by the WWC to correct for clustering within classrooms or schools and for multiple comparisons. For an explanation about the 
clustering correction, see the WWC Tutorial on Mismatch . See Technical Details of WWC-Conducted Computations for the formulas the WWC used to calculate statistical significance. In the case of Pietrangelo (1999), a correction for 
clustering was needed, but the significance levels do not differ from those reported in the original study. 

8. This row provides the study average, which in this instance is also the domain average. The WWC-computed domain average effect size is a simple average rounded to two decimal places. The domain improvement index is calculated 
from the average effect size. 
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